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"PROCESSING METHOD AND SYSTEM i=OR 3-D GEOMETRIC MODELING OF THE SPINE" 
Description 

FIELD OF THE ZNVEfTnON 

The invention relates to an image processing method and a system carrying out this 
method in order to provide three-dimensional geometric modeling of the spine from a 
bipianar image reconstrucdon. 

It has been found that clerical evaluation and diagnostic related to scoliosis need 3-D 
geometric modeling of the spine because scoliosis is a 3-D deformity of the spine. 

TTie invention finds an application in digital radiography for image processing views 
of the spine in order to provide new images appropriate to help diagnosing scoliosis. 
BACKGROUND OF THE INVENTION 

A method of 3-D geometric modeling of the spine from a bipianar image 
reconstruction is already known of the publication "Estimation of 3-D location and orientation 
of human vertebral facet joints from standing digital radiographs", by Y.Petit, J.Dansereau, 
H-Labelle and J.A. de Guise, in "Medical and Biological Engineering and Computing, July 1998 
(Received 6 January 1998). This publication discloses a bipianar radiographic reconstruction 
method of volumes of interest to evaluate the location, dimensions and orientation of human 
facet joints. The method comprises the determination of Areas Of Interest, denoted by AOI, 
in a given vertebra. The AOI is for instance in the shape of a parallelogram, which includes 
the entire facet joint in order to give a good estimation of its location, dimension and 
orientation, and which is defined by its four extremiti^ on two digital radiographs : a 
postero-anterior (PA) and a lateral (L) digital views. The visibility of the four exti«niOes and 
selected landmarks is graded using a six-point scale. For 3-D reconstruction an algorithm 
known of those skilled in the art as direct linear transfomiati'on (DLT) is used. Using this 
method, the 3-D image of the vertebra is reconstructed from the two 2-D images of the 
vertebra. The extremities of the AOI estimated on the PA and L views are reconstructed with 
the same DLT algorithm in order to define the boundaries of the AOI, and of the 
corresponding volume of interest denoted by VOL Such a geometrical representation of VOI 
is considered to give an adequate estimation of facet joint location, dimensions and sagitai 
plane orientation. This method permits of studying individual deformations of each vertebra. 
SUMMARY OF THE INVENTION 

For diagnosing scoliosis, the study of the particular deformation of each vertebra 
comes at an already advanced stage of the patient's follow-up, or is applied to deformations 
limited to a given zone of the spine. A more primary diagnosis is related to the global shape 
of the spine, which might pemirt of determining either that the deformity is local or that the 
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deformity is global, and so might pemiit of detemriining the breadth of the disease. 

To that end, it is a purpose of the Invention to provide an image processing method 
for the three-dimensional (3-D) geometric modeling of the axis of the spine. Such a 3-D 
modeling supplies the global shape of a part or of the totality of the spine axis and permits 
5 of determining the 3-D location and the amplitude of the spine deformity at said location. It 
is also a purpose of the invention to provide such a method that Is as simple as possible in 
order to permit practitioners, who are skilled in the medical field but are no specialists in the 
image processing field, of easily obtaining the required results. It is also a purpose of the 
invention to provide such a method that may be carried out with inexpensive means in order 
10 not to be limited in use by cost problems. 

Such an image processing method is claimed in Qaim 1. 

It is to be noted that , at the present time, image processing packages for the spine 
are, among digital padcages, the ones which are the most required in radiology. As a matter 
of fact, scoliotic patient follow-up is usually done over a long period of time, from which it 

15 results that a large number of X-ray examinations is needed and that the total dose of X-ray 
exposure may be eventually important. Digital radiography reduces the X-ray exposure 
because the quality of the image is improved with respect to standard film radiography. 
Until now, only 2-D image processing packages were currently used. As scoliosis is a 3-D 
deformity of the spine, now 3-D image processing packages are needed. 

20 An advantage of the 3-D geometric modeling of the axis of the spine according to 

Qaim 1 lies in that this modeling is obtained in a very cheap and quick manner usable by 
every radiologist. Only two standard two-dimensional (2-D) digital views of the spine are 
needed and the 3-D Image of the global spine axis is obtained by image processing as soon 
as the radiologist has set of few points for landmarks on each of the 2-D digital views. This 

25 operation of landmark setting is not complicated and is usable by an operator such as a 
radiotogist having no special skill in the field of drawing with computer means. 

SHORT DESCRIPTION OF THE DRAWINGS 

The invention is described hereafter in detail in reference to diagrammatic figured, 
30 wherein : 

RG.IA is a frontal X-ray view of a human body representing the totality of the spine; 
and FIG. IB is a lateral X-ray view of a human body representing the totality of the spine; 

FIG-2A and FIG.2B show the X-ray views of RG.IA and FIG.IB on which central lines 
have been drawn on the representation of the spine; 
35 RG.3A and RG.3B illustrate the determination of the 3-D co-ordinates of points on 

the smoothed central line of the spine; 

RG.4 represents an X-ray imaging system to carry out the method. 



DESCRIPTION OF THE PREFERED EMBODIMENTS 

The invention relates to an image processing method and a system carrying out this 
mediod in order to provide three-dimensional geometric modeling of the spine from a 
5 biplanar image reconstrucb'on. The method comprises steps of : 

a) referring to RG.IA, acquiring a first global radiographic digital lateral view of the 
spine, referred to as L digital view; and, referring to RG.IB, acquiring a second global 
radiographic digital front view of the spine, referred to a F digital view. Each of these views 
shows the spine as may generally be regarded as a non straight ribbon, having a non zero 

10 width and which is substantially symmetrical with respect to a virtual axial line following the 
axis of the bodies of the vertebrae. In FIG.IA and RG.IB this ribbon virtual axial line is 
represented by a doted line. The spine ribbon is denoted by FR in the front view and by LR 
in the lateral view. 

b) referring to RG.2A and RG.2B, drawing a real axial line coinciding at best with 
15 said virtual axial line. In RG-2A and RG,2B this ribtran real axial line is represented by a 

continuous line, which Is denoted by FAL in *e front view and by LAL in the lateral view. 
This operation may be performed using a standard digital drawing means comprising a 
standard drawing program of a computer station having display means to visualize the digital 
F and L digital views, and havirtg a mouse or a key board or other control means to control 

20 the drawing program of the computer station. For example, using the mouse and the 

drawing program, a piece-wise linear curve is drawn from one first point referred to as start 
point, denoted by SP, situated for example on the axis of first upper vertebra, following 
downward the axes of different vertebrae pointing on said axes as best as the operation may 
estimate, until on last point referred to as end point, denoted by EP, on the last lower 

25 vertebra, is reached. Such a piece-wise line is drawn on each of the F and L digital view. 

c) a matching step for matching points of the F and L digital views. In this step, two 
points referred to as first landmarks, denoted PI and P2, are selected on one of the views, 
for instance the F digital view, and two respectively corresponding points referred to as 
semnd landmarics, so also denoted PI and P2, are selected on the other view, for instance 

30 the L digital view. These landmarks PI and P2 are set using the control means, mouse or 
keyboard or other control means, of the computer statton. Such an operation is easily 
feasible by a practitioner having a good knowledge of the anatomical specificity of the spine, 
whidi is of course the case of the radiologist using the present process. This matching step 
is performed using a matching algorithm for estimating a scale factor and a translation factor 

35 for matching the two views. A simple nuitching algorithm may comprise the definition of 

systems of orthogonal reference axes for each view F and L, for instance a first system Xf, Zf 
for the front view F and a second system Yu Zl for ttie lateral view L; in said systems, the 
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first point PI has for ccMrdinates (xr, zfi) and (yu, zu); the second point P2 has for co- 
ordinates (xf2/ zf2) and (yiz, zlz); by writing the linear parametric relations linking the 
coordinates of the landmarks PI and P2 in each plan of view F and L, in die two systems of 
coordinates Xf, Zf, and Yl, Zu it is possible, as known of those skilled in the art, to determine 
5 the parameters of said parametric relations. These parameters are the scale factor and the 
translation factor, whteh make the two systems of coordinates Xf, Zf, and Zl coindde. 
The matching of the two systems of coHDrdinat^ provides a unique system of co-ordinates 
for the two views, denoted X, Y, Z. 

d) spline calculation based on the data of each piece-wise line of the F and L digital 
10 views. The splines are known of those skilled in the art to be piece-wise curves whose pieces 

are associated while respecbng derivative continuity. 

this spline calculation is performed using a spline estimation module, which performs 
mathematical modeling of each drawn piece-wise linear curve and supplies new digital 
smoothed curves, referred to as FAC and LAC in the front and lateral views, said curves 
15 being constructed with interpolated values provided between the points of said piece-wise 
linear curve previously set by the control means of the drawing program. 

e) Referring to FIGs.3A, 3B sampling of the new digital smoothed curves. Points are 
extracted from the new digital smoothed curves at periodically determined ordinates denoted 
by z. So, referring to HG.SA, and the F view, a corresponding x coordinate is determined for 

20 each z coordinate. And referring to FIG.3B and L view, a corresponding y coordinate is 
detemriined for each z coordinate. 

f) construction of the global spine axis 3-D image. This 3-D image is constructed 
using the points whose coordinates are the z, x, y values estimated in the previous step. 

This 3-D image of points may be displayed on the screen of the computer station 
25 using a 3-D standard program. 

g) From the coordinate values z, x, y, numerous diagnostic parameters may be 
derived, particularly interesting parameters to be derived are those providing the geometrical 
torsion of the axis of the spine, which permits of evaluating the degree of deformity of the 
spine. 

30 From those parameters associated with the 3-D image of the graphic line simulating 

the axis of the spine, the practitioner or the radiologist can qualitatively and quantitatively 
evaluate the distortion or non- distortion of the spine and derive therefrom the presence and 
seriousness of scoliosis. These results are obtained very quickly with only two standard 
digital global views of the spine and very simple image processing steps. 

35 It may be needed that the first and second viev/s represent the total length of the 

spine. The invention may also be applied to views representing a same partial length of the 
spine. 
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Referring to RG.4, a system for carrying out the above-described method Is 
represented. The image data of two R-ray views, provided for instance by a medical 
examination apparatus 150, are further provided to an image processing system 120 for 
proofing the data according to the steps of the above-dted method. This image processing 
5 system 120 may be a suitably programmed computer, a processor of a workstation 130, or a 
special purpose proc^sor having drcuit means that are arranged to perform the functions of 
the method steps according to the Invention. The workstation 130 may also comprise a 
screen 140, and a keyboard 131 and a mouse 132 referred to as control means for 
particularly controlling the drawing of the lines FAL and LAL and the setting of maricer points 

10 to represent the landmarks SP, EP, PI, P2 and the points P on the linK FAC and LAC. The 
processing system may be connected to storing means to store the medical images. 

The X-ray medical examination apparatus 150 may comprise an X-ray source, a 
table for receiving a patient to be examined, an optical system for providing image data to 
the processing system 120 which has at least one output 106 to provide image data to 

15 display and/or storage means. The display and storage means may respectively be the 
screen 140 and the memory of a workstation 130 as described In relation to RG.4. Said 
storage means may be alternately external storage means. 

The suitably programmed computer, the processor of the workstation 130, or the 
special purpose processor with drcuit means, use computer program products comprising 

20 sets of instructions for carrying out the method of the invention. 
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Qaims 

1. An image processing nnethod for providing three-dimensional geometric modeling of 
the spine, using a biplanar image reconstaicUon, comprising steps of acquisition of a first 
view (F) of a part of the spine, and a second view (L) of the same part of the spine taken 

5 from a different angle around the longitudinal axis of the spine, matching the dim^sions of 
the views (F,L) from two predetermined corresponding landmarks (PI, P2) on each view and 
deriving three-dimensional coordinates (z, x, y) of corresponding points (P) along the spine. 

2. An image processing method as claimed in Qaim 1, wherein, for matching the two 
views, an axial line (FAL, lAL) is drawn on the spine on each view, and the two landmarks 

10 (PI, P2) are set on said axial line on each view, 

3. An image processing method as claimed in claim 2, wherein the matching of the 
dimensions of the two views is perfbnmed by a calculating matching coordinates [(xfi, zfi), 
(ya, zu); (xf2, zra), {yli, zl2)] for the two corresponding landmarks (PI, P2). 

4. An image ptDcessing method as claimed in Qaim 3, wherein a common system of 
15 coordinates (Z, X, Y) is detenmined for the two views, from the matched coordinates of the 

two corresponding landmarks. 

5. An image processing method as claimed in one of dalms 2 to 4, wherein spline 
calculation is performed for providing smoothed axial line (FAC, LAC) on each view. 

6. An image processing method as daimed in one of daims 2 to 5, wherein three- 

20 dimensional coordinates (z, x, y) of corresponding points along the spine are determined for 
points (P) regularly spaced along the axis of coordinates (Z) corresponding to the 
longitudinal axis of the spine. 

7. An image prcxiessing mettiod as claimed in one of claims 2 to 6, wherein the 
common system of coordinates is an orthogonal system, the first view Is a frontal view (F), 

25 the second view Is a lateral view (L) orthogonal to the frontal view, with a common axis (Z) 
In the direction of the longitudinal axis of the spine, a second axis (X) parallel to the frontal 
plane of view and the third axis (Y) parallel to the lateral plane of view. 

8. An Imaging system having acquisition means for acquiring a first and a second view 
of the spine, having display means to display the two views of the spine, having drawing 

30 means to draw axial lines of the spine and to set predetermined corresponding landmarks on 
each view and having processing means to calculate three-<iimensionat coordinates of points 
along the spine according to the method as daimed in one of daims 1 to 7. 

9. An imaging system as daimed in Qaim 8, wherein the processing means comprise a 
suitably programmed computer of a workstation or a spedal purpose processor having drcuit 

35 means, which are arranged to process image data according to the method as daimed in 
any of Claims 1 to 7, and wherein the display means display images processed according to 
said method, further comprising means to store the image data. 



Q 



10- An X-ray examination apparatus having a system as claimed in one of Qaims 8 or 9. 
11. A computer program product comprising a set of instructions for carrying out the 
method as claimed in one of Claims 1 to 7. 
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Abstract 



An image processing method for providing three-dimensional geometric modeling of 



the spine, using a biplanar image reconstruction, comprising steps of acquisition of a first 
5 view (F) of a part of the spine, and a second view (L) of the same part of the spine taken 
from a different angle around the longitudinal axis of the spine, matching the dimensions of 
the views (F,L) from two predetermined corresponding landmarks (PI, P2) on each view and 
deriving three-dimensional coordinates (z, x, y) of corresponding points (P) along the spine. 

10 

Rgures : RG.2A, RG.2B 

Application : X-ray medical 3-D imaging. 
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